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Office Action Summary 



Application No, ^~ > 

09/577,487 


Applicants) 
HEATH, THOMAS S. 


Examiner 
Chrlss S. Yoder, III 


Art Unit 
2612 





Perfod for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified a bove is less than thirty (30) days, a reply wfthln the statutory minimum of thirty (30) days wiD be considered timely. 

- If NO period for reply la specified above, the maximum statutory period wftl apply and wQI expire S!X<6) MONTHS from (he malting date of thla communication. 

- Failure to reply within the set or extended period for reply wilt, by statute, cause the application to beoome ABANDONED (35 U.S.C, § 133). 
Any reply received by the Office later than three months gfler the mailing date of this communication, even if timely filed, may reduce any 
earned patent lean adjustment. See 37 CFR 1 .704(b). 

Status 

Responsive to communication (s) filed on 13 May 2004 . 
2a)IS This action is FINAL. 2b)D This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits Is 

closed in accordance with the practice under Ex parte Quayte, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) 0 Claim(s) 1-4.7-10 and 12-15 is/are pending in the application. 

4a) Of the above cfaim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) S Ciaimfe) 1-4.7-10 and 72-75 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) \3 Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) Q The specification is objected to by the Examiner. 

10) E3 The drawing(s) filed on 25 May 2000 Is/are: a)G3 accepted or objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held In abeyance. See 37 CFR 1.85(a). 
Replacement drawing sheets) Including the correction is required if the drawing(s) Is objected to. See 37 CFR 1.121(d). 

1 1) D The oath or declaration is objected to by the Examiner. Note the attached Office Action orform PTO-152. 

Priority under 36 U.S.C. § 119 

12) Q Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (0. 
a)D All b)D Some * c)D None of: 

Certified copies of the priority documents have been received. 

Certified copies of the priority documents have been received in Application No. . 
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Copies of the certified copies of the priority documents have been received In this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
• See the attached detailed Office action for a fist of the certified copies not received. 



Attachment(s) 

1) □ Notice of References Cited (PTO-892) 

2) CU Notice of Draftsperson's Patent Drawing Review (PTO-948) 

3) □ Information Disclosure Statements) (PTO-1449 or PTO/SB/08) 

Paper No(s)/MaII Date . 



4) □ Interview Summary (PTO-413) 

Paper No(syMaii Date. . 

5) □ Notice of Informal Patent Application (PTO-152) 

6) □ Other: , 



U.S. Patent and Trademark Office 

PTOt-326 (Rev. 1-04) 



Office Action Summary 



Part of Paper No./Mali Date 5 
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DETAILED ACTION 



Response to Arguments 



Applicant's arguments with respect to claim 1-4, 7-10, and 12-15 have 
been considered but are moot in view of the new ground(s) of rejection. 



The following is a quotation of 35 U.S.C. 103(a) which forms the basis for 
all obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described 
as set forth in section 102 of this title, if the differences between the subject matter sought to 
be patented and the prior art are such that the subject matter as a whole would have been 
obvious at the time the invention was made to a person having ordinary skill in the art to which 
said subject matter pertains. Patentability shall not be negatived by the manner in which the 
invention was made. 



1 . Claims 1-4, 7-10, and 12-15 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Burt et at. (US Patent # 6,999,662) in view of Yagi et al. (US 



Patent # 6,268,884) and further in view of Takiguchi et al. (US Patent # 
6,549,681). 

2. In regard to claim 1 , note Burt discloses the use of a computer 
implemented method comprising extracting a first and a second individual frame 
of imagery from a series of video frames (column 17, lines 38-41; and figure 2B; 
the images are taken sequentially, a first and second individual frame), 
determining regions of interest in order to overlap two images (column 17, lines 
45-47), identifying commonality from the first frame to the second frame (column 
1 7, lines 45-47), and overlapping the individual frames based on the commonality 
identified from the first and second frames (column 17, lines 45-47) and 
displaying and image representing a continuous area (column 4, lines 55-60). 



Claim Rejections - 35 USC § 103 
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Art Unit: 2612 [ 

Therefore, it can be seen that the Burt device fails to detect edges of an object in 
the first and second frames and the correlation of regions of interest by 
comparing each region of interest to each other region of interest. Yagi discloses 
the detection of the edge of an object by detecting changes in the intensity from 
one pixel to another (column 5, tines 21-24; after detecting the brightness values, 
the outline of the image is created). Yagi teaches that the detection of the edge 
of an object by detecting changes in the intensity from one pixel to another and 

~ /■ ?< 

drawing a line at the detected edge is preferred in order to outline the objects to 
compensate for the roughness of edges (column 5, lines 50-55). Takiguchi 
discloses the correlation of regions of interest by comparing each region of 
interest to each other region of interest (column 32, lines 45-67; the correlation is 
done using the comparison of regions from one frame to the next; and figures 47, 
49, and 50). Takiguchi teaches that the correlation of regions using comparison 
is preferred in order to ensure that the correct regions are going to be overlapped 
to accurately create the correct mosaic (column 31 , lines 60-65). Therefore, it 
would have been obvious to one of ordinary skill in the art to modify the Burt 
device to include the use of edge detection of an object in the first and second 
frames and the correlation of regions of interest by comparing each region of 
interest to each other region of interest as suggested by Yagi and Takiguchi. 
3. In regard to claim 2, note Burt discloses the use of a computer 
implemented method comprising extracting individual frames of imagery taken 
from video, identifying commonality from one frame to the next, and overlapping 
the individual frames and displaying and image representing a continuous area. 
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Therefore, it can be seen that the Burt device lacks the use of a camera that 
takes images at 30 frames per second. Official notice is taken that the concepts 
and advantages of using a camera that takes images at 30 frames per second 
are notoriously well known and expected in the art. Therefore, it would have 
been obvious to one of ordinary skill in the art to modify the Burt device to include 
the use of a video camera that takes images at 30 frames per second in order to 
allow the video to also be displayed on a conventional television. 

4. In regard to claim 3, note Burt discloses the use of MPEG compression to 
store the images (column 15, lines 3-6). 

5. In regard to claim 4, note Burt discloses the conversion of MPEG files into 
black and white images (column 5, lines 7-12). 

6. In regard to claim 7, note Burt discloses the compensation of 
platform/camera motions (column 19, lines 12-15). 

7. In regard to claim 8, note Yagi discloses the detection of the edge of an 
object (column 5, lines 21-24; and figure 5), follow adjacent pixels until an off 
pixel is detected (column 5, lines 21-24; and figure 5), and repeating the process 
for the entire image (column 5, lines 21-24; and figure 5). And Takiguchi 
discloses the counting of pixels and comparing the total to a threshold (figure 28: 
S1303-S1304; if the number of pixels is greater than the threshold, then continue 
with the image overlapping, otherwise look for other structures). 

8. In regard to claim 9, note Yagi discloses the storage of the location of on 
pixels within each designated structure (column 6, lines 10-15). 
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9. In regard to claim 10, note Yagi discloses the creation of a line in the 
image to distinguish where the structure is located (column 5, lines 21-24; 
column 5, lines 50-55; it would be implied that in the process of creating this line 
the pixel values are changed in order to compensate for the roughness of edges, 
thereby avoiding the use of these pixels in future structures). 

10, In regard to claim 12, note Takiguchi discloses the calculation of a 
centroid for each region of interest in the first frame (figure 47: A-1), comparing 
the centroid in the first frame with the centroids in the next frame (column 32, 
lines 45-67), selecting the centroid in the second frame within an error tolerance 
(column 32, lines 45-56), correlating an average distance from every pixel in the 



